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Adaptive self-organization in a realistic neural network model 
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Information processing in complex systems is often found to be maximally efficient close to critical 
states associated with phase transitions. It is therefore conceivable that also neural information 
processing operates close to criticality. This is further supported by the observation of power-law 
distributions, which are a hallmark of phase transitions. An important open question is how neural 
networks could remain close to a critical point while undergoing continual change in the course of 
development, adaptation, learning, and more. An influential contribution was made by Bornholdt 
and Rohlf, introducing a generic mechanism of robust self-organized criticality in adaptive networks. 
Here we address the question whether this mechanism is relevant for real neural networks. We show 
in a realistic model that spike-time dependent synaptic plasticity can self-organize neural networks 
robustly toward criticality. Our model reproduces several empirical observations and makes testable 
predictions on the distribution of synaptic strength, relating them to the critical state of the network. 
These results suggest that the interplay between dynamics and topology may be essential for neural 
information processing. 

PACS numbers: 87.18.Sn, 05.65.-|-b, 89.75.Fb, 64.60.Ht 



I. INTRODUCTION 

Dynamical criticality has been shown to bring about 

ftimal information transfer and storage capabilities ^j- 
and sensitivity to external stimuli [j, |5| making it an 
attractive concept for neural dynamics (6|-|8|. Evidence 
for dynamical criticality in neural netviforks is found in 
vitro, in cell cultures and in slices of rat cortex [T], and 
in vivo 0, where avalanches of neuronal activity ob- 
served to follow a power-law size distribution with expo- 
nent -1.5. On a larger spatial scale of human electroen- 
cephalography (EEG), measurements of electrical activ- 
ity in the brain show that the power spectrum of back- 
ground activity follows a power-law 0, [lol - [l^ which has 
also been linked to criticality [H, [l^] ■ Recently, also mea- 
sures of phase synchronization were demonstrated to fol- 
low power-law scaling in functional magnetic resonance 
imaging (MRI) and magnetoencephalographic (MEG) 
data recorded from humans, indicating critical dynam- 
ics [11]. 

Despite the empirical evidence, few generative mecha- 
nisms explaining the purported criticality have been pro- 
posed. What is needed is an robust mechanism that 
drives the system back to the critical state after a pertur- 
bation. In the theoretical literature, self-organized crit- 
icality (SOC), the ability of systems to self-tune their 
operating parameters to the critical state, has been dis- 
cussed for a long time [isj . A major new impulse came 
from the discovery of network-based mechanisms, which 
were first reported in [l6j and explained in detail in 
[iTllTsj. These works showed that adaptive networks, i.e., 
networks combining topological evolution of the network 
topology with dynamics in the network nodes [l^ |20| . 
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can exhibit highly robust SOC based on simple local 
rules. 

The essential characteristic of adaptive networks is the 
interplay between dynamics ON the network and dynam- 
ics OF the network. In the case of neural networks the 
dynamics on the networks is the activity of the individ- 
ual neurons. Dynamics of the network appear in many 
forms, but include the rewiring of neural connections in 
the developing brain and synaptic plasticity, the dynami- 
cal change of synaptic strength. In real world neural net- 
works the formation of connections and all but the fastest 
mechanism of plasticity are clearly much slower than the 
dynamics of the neurons. For this reason both types 
of dynamics can be assumed to take place on separate 
timescales: On a short timescale the dynamics of neu- 
ronal activity occurs in a network with quasi-static topol- 
ogy. Only on a longer timescale, the topology evolves de- 
pending on the time-averaged, and therefore also quasi- 
static patterns of neuronal activity. 

The basic mechanism of adaptive SOC can be ex- 
plained as follows: Dynamics on networks are in general 
sensitive to the network topology, the specific pattern of 
nodes and links. Remarkably, even the dynamics in a 
single network node may provide information on global 
topological order parameters, if the node is observed for 
sufficient time. Thus, the dynamics explores the net- 
work making certain global topological properties locally 
accessible in every network node. In adaptive networks 
this information can then be utilized by a local topolog- 
ical update rule that slowly drives the network toward 
criticality. 

The investigation of conceptual models of adaptive 
SOC [l^, [13] has shown that the presence of this type of 
self-organization in human neural networks is plausible. 
Independently, robust SOC has recently been demon- 
strated in neural models [2l| - [23| . which also fall into the 
class of adaptive networks. The aim of the present work is 
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to assess whether adaptive SOC can self-organize a reahs- 
tic model of neural network robustly to criticality. In par- 
ticular, we consider topological self-organization driven 
by spike-time dependent synaptic plasticity (STDP). We 
find that the final state the network approaches is critical, 
albeit different from the states that were approached in 
previous models using activity-dependent (homeostatic) 
mechanism of plasticity. 

II. DESCRIPTION OF THE MODEL 

We consider a network of N leaky integrate-and-fire 
neurons. In contrast to previous works, which focused on 
inhibitory interactions /Z], we study a network of 80% 
excitatory to 20% inhibitory neurons, which is realistic 
for cortical networks [1^. In the absence of a stimulus, 
the membrane potential, Vi , of neuron i follows the equa- 
tion 

^V, = - — [v^-Vo] (1) 

dt r,„ 

describing an exponential return to the resting poten- 
tial Vq on a timescale given by t„i. Whenever a neuron 
receives an input from a pre-synaptic neuron j we up- 
date the membrane potential by adding [V^cv — Vi]gc if 
the pre-synaptic neuron is excitatory, or — [T4ov — 'fi]gc 
if the pre-synaptic neuron is inhibitory. If the update 
causes the membrane potential to reach or exceed the 
threshold Vth then the potential is reset to K-csct for a 
refractory period r^cf after which it evolves again accord- 
ing to Eq. ([T|). Upon reaching the threshold the neuron 
fires a spike, which reaches the connected post-synaptic 
neurons after a travel-time delay T^eUy = 1.0ms. 

Note that spikes can only be fired directly upon receiv- 
ing an excitatory input. Consequently spikes are fired at 
times that are integer multiples of the travel-time delay. 
Thus the travel-time defines a natural timestep which 
we also use as the timestep of our simulation. Between 
spikes the membrane potential of a neuron is updated 
using the analytical solution of Eq. ^ . The system can 
thus be simulated without suffering from the inaccuracies 
that are often introduced by numerical integration. 

The topology of the network changes due to spike-time 
dependent plasticity (STDP) [l^llal, which is believed 
to alter the topology of the network on a timescale that 
is much slower than the spiking dynamics (some hundred 
milliseconds to some seconds [2^ H^] ) . 

Exploiting the timescale separation we proceed as fol- 
lows: We simulate the dynamics on the network accord- 
ing to the rules described above for a long time isim- 
Only when the simulation has finished the topology is 
changed according to an update rule explained below. 
The timescale tsim is chosen sufficiently long for the sys- 
tem to reach a dynamical attractor. Specifically, we as- 
sume that this is the case when the neurons have fired 
in average 100 spikes or all activity on the network has 
stopped. Once the attractor has been reached further 



simulation does not reveal additional information, as the 
system remains on the attractor (see e.g. [13 )• The ex- 
act choice of igim is therefore of no consequence, provided 
that it is sufficiently long. In the present model, this was 
confirmed numerically. 

The STDP update rule captures the effect of the tem- 
poral order of spikes between pairs of neurons [25l - [27| . 
Following Refs. [28, 29], we model this behavior by intro- 
ducing internal variables Xi and Ui linked to the activity 
of a neuron i. The variable Xi encodes the time that has 
passed since the last spike of neuron i, while counts 
the total number of spikes observed so far. At all times 
at which neuron i spikes, both Xi and Ui are increased by 
1. Between spikes Xi decays with a time constant tstdp, 
such that 

^x,^^^^+Y,s{t-n. (2) 

dt TSTDP 

The temporal order of spikes between two neurons i,j 
can be captured by introducing one more variable c^. 
When neuron i spikes this variable is decreased by xj, 
while when j spikes it is increased by Xi. Therefore the 
variable will be increased if the neurons spike in the se- 
quence i,j while it is decreased if the neurons spike in the 
sequence j, i. The increase/decrease is more pronounced 
in neurons spiking shortly after each other. 

At the end of the simulation run the topology is up- 
dated depending on the variables introduced above. De- 
pending on the specific question under consideration we 
use either one of two variants of the topological update 
rule. The first mimics the formation of neural connec- 
tions in the developing brain where activity-dependent 
processes are considered to be a prominent mechanism in 
shaping topographic maps during development of cere- 
bral connectivity [10, [Hi . At the time of the topology 
update, a random Cij is picked. If Cij /{rii + nj) is greater 
or equal than the threshold ^stdp = 0.4, a new synapse 
from neuron i to neuron j with Qc — 0.15 is created, if it 
is smaller than the threshold and a synapse from neuron 
i to neuron j exists, this synapse is deleted. 

For the investigation of the self-organization of synap- 
tic conductance, we use a variant update rule, in which 
we alter the conductance of a synapse from neuron i to 
j as gij — WijQc- If Cij/ {rii + nj) is greater or equal than 
the threshold ^stdp, the weight Wij is increased, if it is 
smaller, Wij is decreased by a fixed value A, unless this 
would cause Wij to become negative or exceed one. 

After the update rule has been applied, we restart the 
system by assigning random membrane potentials to the 
neurons and setting two percent of the neurons above 
threshold. The procedure of simulating the dynamics 
and then applying the topology update rule is iterated 
to allow the network topology to relax to a self-organized 
state. 

While our model aims to be as realistic as possible, 
there are three particulars of real brain networks that 
we cannot capture: the detailed organization of brain ar- 
eas, the enormous number of neurons (approx. 10^"'^) and 
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the large average number of synapses connecting to ev- 
ery neuron (approx. 10'* for cortical neurons) While 
it can be assumed that the detailed organization is only 
of secondary importance for the questions at hand, it 
is clear that the level of neuronal activity depends on 
the average number of synaptic inputs. As we will see 
in the following, the activity self-organizes to a certain 
level. Setting the number of synapses to a low/high 
value therefore causes the synaptic conductances to self- 
organize to correspondingly high/low levels. Conversely, 
if we fix the synaptic conductance at a low/high level, the 
number of synapses self-organizes to a high/low value in 
turn. Therefore (unrealistically) strong synapses have to 
be assumed in numerical simulations to keep the num- 
ber of synapses in a feasible range. The impact of this 
assumption is discussed below. 

Apart from the synaptic conductances gc = 0.15 all 
other parameters are set to realistic values. Specifically, 
T,„ = 30.0ms, Vo = O.OmV, Kcsot = 13.5mV, Vtk = 
15.GmV, Vrcv = 33.5mV, Tdoiay — 1.0ms, Tiof — 3.0ms, 
TsTDP = 5.0ms MM- 



III. RESULTS 

As a first test for self-organization, we monitor the con- 
nectivity of the model networks, while they evolve under 
the influence of the STDP update rule. For this purpose 
the first variant of the update rule is used. Starting with 
random networks with each neuron having on average 
synaptic connections to K other neurons, the system ap- 
proaches a characteristic connectivity ifcv independent 
of initial conditions. A representative set of timeseries is 
shown in Fig. [TJ Additional investigations (not shown) 
confirm that K^v is robust against variation of numerical 
constants such as tgim- 
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FIG. 1: Self-organization of network connectivity. Starting 
from different initial conditions different networks approach 
the same final level of self-organized connectivity. The exem- 
plary data shown here was obtained in simulations of networks 
of N = 500 neurons. While the time-scale separation makes it 
difficult to relate the iterations directly to biological time the 
20000 iterations in this figure correspond to at least 6000s. 



In order to investigate how our assumptions affect the 
self-organized level of connectivity, we simulate the evolu- 
tion of networks for different synaptic strength and net- 
work sizes. We find that the value of Kcv scales with 
system size according to the scaling law 
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shown in Fig. [5] The best fit to the numerical observa- 
tions is provided by the parameter values K^o = 2.58, 
a = 266.1 and /3 = 1.382. Computing similar fits for 
different values of the synaptic conductance we find the 
scaling law 



(4) 



with b = 0.1633, 7 = 1.565 and c = -0.3916 (see Fig. [H 
inset). 

In real neural networks, a few tens of simultaneous 
excitatory post-synaptic potentials are sufficient to ele- 
vate the membrane potential from its reset value to spike 
threshold [s^l- A typical number is about 20 inputs cor- 
responding to a conductance of gc = 0.000375 in our 
model. Substituting this value into Eq. (|4]) we obtain 
Koo ~ 40000. While this extrapolation certainly pro- 
vides only a very rough estimate it is reassuring to see 
that the result is in the order of magnitude of the con- 
nectivity observed for cortical neurons [36j . 
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FIG. 2: (Color online) Scaling of the self-organized connectiv- 
ity. The final value of connectivity approached in simulation 
follows a power-law depending on the number of neurons A*' 
and synaptic conductances Qc (inset). The values shown were 
found by averaging over 30000 iterations and 3 estimates of 
the connectivity K^a- 

To show that the state approached by the network is 
critical, we first investigate the dynamics on random net- 
works without synaptic plasticity so that the topology 
remains static. Previous studies [l3,[3 have shown that 
it is advantageous to quantify the dynamics by defining 
an order parameter Csyn(^) as an average over pairs of 
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neurons of the correlations between neurons i,j 



ta+T 



1 ^ 

t = to 



(5) 



where ai{t) is one if the neuron i spiked at time t and 
zero otherwise. This quantity is evaluated over a time r 
which we here consider equal igim • Figure [3] shows Cgyn 
averaged over random network topologies, for different 
connectivities and network sizes. This averaged order 
parameter, (Cgyn), increases at a threshold around K = 
2.5 which becomes more pronounced in larger networks 
indicating the existence of a continuous phase transition 
corresponding to the onset of synchrony in neural activity 
in the limit of large network size. 

As a second step, we compute the net gain of links if 
the STDP rule were applied. Figure [3] shows that the 
STDP increases the connectivity of sparsely connected 
networks but decreases the connectivity of more densely 
connected networks. This constitutes an effective force 
toward the phase transition at K^^ ■ 

The critical threshold Kstbp at which the transition 
occurs in Fig. [3] corresponds approximately to the self- 
organized connectivity Koo in the dynamic network. An 
exact match cannot be expected since the evolved net- 
works are no longer random graphs but may exhibit long 
range correlations in the topology that shift the threshold 
to higher or lower connectivities. 

A hallmark of continuous phase transitions is the 
power-law distribution of microscopic variables related to 
the order parameter. We therefore compute the distribu- 
tion of the spike-time correlation, Cgyn, in the evolving 
networks. In the self-organized state, we find Csyn to 
be distributed according to a power-law (Fig. While 
our numerical approach imposes strong cut-offs, already 
the observation of power-law scaling of the variable asso- 
ciated with the order parameter over one decade, pro- 
vides additional evidence for the dynamical criticality 
in the evolved state. Our results are reminiscent of 
recent functional MRI and MEG measurements in hu- 
man brains, which demonstrated a remarkably robust 
power-law scaling of two different synchronization mea- 
sures over a broad ran ge o f frequencies and different pairs 
of anatomical regions |14l |. 

A current question not yet fully resolved by empirical 
data concerns the distribution of synaptic weights in real 
neural networks. To investigate this distribution in our 
model, we abandon the deletion and creation of synapses 
and instead switch to the variant STDP update-rule in 
which the weights of the synapses are increased or de- 
creased. With the variant update rule, we observe that 



the connectivity, now defined as K — 



i/N, ap- 



proaches the same value i^sTDP that is found with the 
boolean update rule. In the critical state a large frac- 
tion of synaptic weights is zero, which is in agreement 
with empirical evidence (37j . In our simulation the exact 
size of this fraction depends strongly on the number of 
synapses. 
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FIG. 3; Self-organization to the synchronization phase tran- 
sition. Top: Synchrony of spikes in static networks, measured 
in terms the order parameter (Csyn (if )) as a function of the 
connectivity K. The presence of a threshold aX K ~ 2.5 (line) 
is indicative of the existence of a phase transition in the limit 
of large network size. Bottom: Change of connectivity, ex- 
pressed by the expected average net gain of hnks per itera- 
tion. Links are added if network connectivity is below the 
threshold and deleted if it is above the threshold, constitut- 
ing a driving force toward the phase transition. Samples are 
averaged over 10^ random initial conditions for = 100 and 
10^ random initial conditions for N = 10000 and iV = 1000. 



As shown in Fig.|4l the distribution of synaptic weights 
in the evolved state follows a power-law with exponent 
— 1.5. The self-organization to an identical distribution 
was also observed in further simulations (not shown) us- 
ing different and/or asymmetric values of A for strength- 
ening or weakening updates, as proposed in [29']. Interest- 
ingly, a similar scaling behavior regarding the observed 
power-law for synaptic strengths in our model was found 
to play a role in models of network pruning jss} . The au- 
thors relate this observation to the sparseness of networks 
which is also an outcome of the present model. 

For comparison of the self-organized distribution with 
empirical data, Fig.|3]also shows measurements of synap- 
tic weights from somatic recordings of different anatom- 
ical areas in the brain j39l - l45j summarized in [37| . From 
these recordings the two smallest values are neglected, 
since measurements of small weights are typically under- 
estimated as they are likely to fall below the detection 
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threshold 'st'] . Comparing the combined data sets to the 
numerical results reveals a close resemblance. While this 
could be interpreted as an indication that the brain as a 
whole is in a self-organized critical state, such a claim is 
highly questionable, as, at least, the organization into dif- 
ferent brain areas is certainly not self-organized. Consid- 
ered individually, the data-sets curve slightly downwards 
in the double- logarithmic plot, which is indicative of an 
exponential distribution [4g]. However, statistical tests 
|47| reveal that a power-law relationship can not be ex- 
cluded at least for CortexL2 (1), CortexL2 (2), CortexL5 
(2), Hippocampus and Cerebellum. The exponent pro- 
viding the best fit for such a power law closely matches 
the value of —1.5 found in our simulations. 
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FIG. 4: (Color online) Power-law distributions in the self- 
organized state. Top: Distribution of the measure for spike- 
time synchrony Csyn at the self-organized state. The distri- 
bution follows a power-law with exponent —2 as indicated by 
the dashed line. Bottom: Distribution of synaptic weights in 
a self-organized critical state together with probability densi- 
ties of synaptic weights from experimental data !37]. Synap- 
tic weights of experimental data are in mV, the probability 
density in mV~^, respectively. The dashed line indicates a 
power-law with exponent —1.5. The data shown were com- 
puted in a network with A'' — 1000 and A = 0.01. 



IV. DISCUSSION 

In this work we have investigated a realistic model 
of neural networks, capturing the interplay between the 
integrate- and-fire dynamics of neurons and spike-time de- 
pendent synaptic plasticity. We observed that the net- 
works robustly evolved to a state characterized by the 
presence of power-laws in the distribution of synaptic 
conductances and the synchronization order parameter 

C'syii . 

Our results provide strong evidence for self-organized 
criticality. In particular they indicate that a previously 
proposed mechanism, based on the interplay of dynamics 
and topology in adaptive networks [17, 18], can robustly 
self-organize realistic models of neural networks to criti- 
cal states. This suggests that this mechanism could also 
drive the self-organization to criticality recently observed 
in other models [III, j^l, HI] . 

Apart from the higher degree of realism, our model 
differs from previous works in the nature of the synaptic 
plasticity. We find that spike-time dependent plasticity 
drives the network to a critical state that marks the on- 
set of synchronous activity. By contrast, previous models 
based on activity- dependent update rules, found a self- 
organization toward a different critical state correspond- 
ing to an order-disorder phase transition [13, • Since 
both types of plasticity have been observed in nature 
it is promising to study their combined effect in future 
models. It is interesting to note that the order-disorder 
transition mainly depends on the average connectivity of 
the network, while the synchronization transition is much 
more sensitive to larger topological motifs. The com- 
bined effect of activity-dependent and spike-time depen- 
dent mechanisms could therefore potentially self-organize 
the network to both thresholds simultaneously. 

One question that we have not studied in detail in this 
work concerns the topology that evolves in the model. 
However, the observation of sustained activity in rela- 
tively small networks with realistic refractory times sug- 
gests the evolution of highly non-random topologies on 
which activity can propagate similarly to synfire chains. 
Results from an earlier work showed that STDP can re- 
organize a globally connected neural network into a func- 
tional network, which is both small-world and scale-free 
with a degree distribution following a power-law with an 
exponent similar to the one for synaptic weights in our 
model [llj. Similarly, [2^ showed that Hebbian learn- 
ing can rewire the network to show small-world prop- 
erties and operate at the edge of chaos. Robust self- 
organization of scale-free topologies was also observed in 
a study of spike-time dependent network modifications 
with node dynamics based on coupled logistic maps (49| . 

Certainly the most important question is if the mech- 
anism studied here is also at work in real neural net- 
works. To this end note that our observations were based 
on the interplay of two well-accepted ingredients: spike- 
time dependent plasticity and integrate-and-fire neurons. 
We observed that the coupling of these ingredients yields 
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results that are in good agreement with empirical ob- 
servations. We therefore conclude that also the self- 
organization to criticality should take place in nature, 
unless factors exist that specifically disrupt it. The evolu- 
tion of such factors should be disfavored as critical states 
are believed to be advantageous for information process- 
ing. Furthermore, the basic adaptive mechanism for self- 
organization, considered here, has by now been observed 
in several different models. It is therefore unlikely that 
this mechanism is disrupted by specific details rooted in 
the biochemistry and biophysics of the neurons. Also, the 
local nature of the mechanism conveys a high robustness 
against noise [l7| , which appears in real world networks 
due to true stochasticity and in the form of external in- 
puts. Finally, finite-size effects, which strongly constrain 
self-organized criticality in many systems, are unlikely 
to play a role in human cortical networks because of the 
large number of neurons and synapses. Therefore, the ob- 
servation of self-organization to criticality in the realistic 
model, studied here, shows that similar self-organization 



in real neural networks is likely. 

Perhaps the most controversial prediction of the cur- 
rent model is that synaptic weights should follow a power- 
law. Although it is often assumed that the real weight 
distribution is exponential, to our knowledge, no mecha- 
nistic model reproducing the observed distributions has 
been proposed. Moreover, at least in certain brain ar- 
eas, the hypothesis that synaptic weights are distributed 
according to a power-law cannot be rejected on empir- 
ical grounds. While further investigations are certainly 
necessary, the mechanism studied here can therefore po- 
tentially provide a rationale explaining the observed dis- 
tributions in these brain areas. 
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